Skip to content

Add dimensions parameter to ingest method#565

Merged
kounelisagis merged 2 commits into
mainfrom
agis/consider-current-domain
Sep 18, 2025
Merged

Add dimensions parameter to ingest method#565
kounelisagis merged 2 commits into
mainfrom
agis/consider-current-domain

Conversation

@kounelisagis

@kounelisagis kounelisagis commented Feb 11, 2025

Copy link
Copy Markdown
Member

This PR adds an optional dimensions parameter to the ingest method to allow overriding the dimensions detected from source arrays. This fixes an issue coming from TileDB-SOMA, where dimension domains are set to ~2^63 and cause TileDB-Vector-Search to detect ingest the whole domain.


Fixes #564
[sc-62701]

@teo-tsirpanis
teo-tsirpanis removed the request for review from NikolaosPapailiou March 4, 2025 13:20
Comment thread apis/python/src/tiledb/vector_search/ingestion.py Outdated
@kounelisagis
kounelisagis force-pushed the agis/consider-current-domain branch from efd6d46 to 22a0f6d Compare September 9, 2025 15:10
@kounelisagis kounelisagis changed the title [WIP] Support Current domain in ingestion code Add dimensions parameter to ingest method Sep 9, 2025
@kounelisagis
kounelisagis marked this pull request as ready for review September 9, 2025 15:51
@kounelisagis
kounelisagis merged commit c7e97fc into main Sep 18, 2025
7 checks passed
@kounelisagis
kounelisagis deleted the agis/consider-current-domain branch September 18, 2025 12:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use array "current domain" for vector dimension

3 participants